Evaluating the Usability of an mHealth App for Empowering Cancer Survivors With Disabilities: Heuristic Evaluation and Usability Testing.

BACKGROUND: More than 18 million cancer survivors are living in the United States. The effects of cancer and its treatments can have cognitive, psychological, physical, and social consequences that many survivors find incredibly disabling. Posttreatment support is often unavailable or underused, especially for survivors living with disabilities. This leaves them to deal with new obstacles and struggles on their own, oftentimes feeling lost during this transition. Mobile health (mHealth) interventions have been shown to effectively aid cancer survivors in dealing with many of the aftereffects of cancer and its treatments; these interventions hold immense potential for survivors living with disabilities. We developed a prototype for WeCanManage, an mHealth-delivered self-management intervention to empower cancer survivors living with disabilities through problem-solving, mindfulness, and self-advocacy training. OBJECTIVE: Our study conducted a heuristic evaluation of the WeCanManage high-fidelity prototype and assessed its usability among cancer survivors with known disabilities. METHODS: We evaluated the prototype using Nielsen's 10 principles of heuristic evaluation with 22 human-computer interaction university students. On the basis of the heuristic evaluation findings, we modified the prototype and conducted usability testing on 10 cancer survivors with a variety of known disabilities, examining effectiveness, efficiency, usability, and satisfaction, including a completion of the modified System Usability Scale (SUS). RESULTS: The findings from the heuristic evaluation were mostly favorable, highlighting the need for a help guide, addressing accessibility concerns, and enhancing the navigation experience. After usability testing, the average SUS score was 81, indicating a good-excellent design. The participants in the usability testing sample expressed positive reactions toward the app's design, educational content and videos, and the available means of connecting with others. They identified areas for improvement, such as improving accessibility, simplifying navigation within the community forums, and providing a more convenient method to access the help guide. CONCLUSIONS: Overall, usability testing showed positive results for the design of WeCanManage. The course content and features helped participants feel heard, understood, and less alone.

A qualitative analysis of algorithm-based decision support usability testing for symptom management across the trajectory of cancer care: one size does not fit all.

BACKGROUND: Adults with cancer experience symptoms that change across the disease trajectory. Due to the distress and cost associated with uncontrolled symptoms, improving symptom management is an important component of quality cancer care. Clinical decision support (CDS) is a promising strategy to integrate clinical practice guideline (CPG)-based symptom management recommendations at the point of care. METHODS: The objectives of this project were to develop and evaluate the usability of two symptom management algorithms (constipation and fatigue) across the trajectory of cancer care in patients with active disease treated in comprehensive or community cancer care settings to surveillance of cancer survivors in primary care practices. A modified ADAPTE process was used to develop algorithms based on national CPGs. Usability testing involved semi-structured interviews with clinicians from varied care settings, including comprehensive and community cancer centers, and primary care. The transcripts were analyzed with MAXQDA using Braun and Clarke's thematic analysis method. A cross tabs analysis was also performed to assess the prevalence of themes and subthemes by cancer care setting. RESULTS: A total of 17 clinicians (physicians, nurse practitioners, and physician assistants) were interviewed for usability testing. Three main themes emerged: (1) Algorithms as useful, (2) Symptom management differences, and (3) Different target end-users. The cross-tabs analysis demonstrated differences among care trajectories and settings that originated in the Symptom management differences theme. The sub-themes of "Differences between diseases" and "Differences between care trajectories" originated from participants working in a comprehensive cancer center, which tends to be disease-specific locations for patients on active treatment. Meanwhile, participants from primary care identified the sub-theme of "Differences in settings," indicating that symptom management strategies are care setting specific. CONCLUSIONS: While CDS can help promote evidence-based symptom management, systems providing care recommendations need to be specifically developed to fit patient characteristics and clinical context. Findings suggest that one set of algorithms will not be applicable throughout the entire cancer trajectory. Unique CDS for symptom management will be needed for patients who are cancer survivors being followed in primary care settings.

Combining user-centered design and behavioral theory to enhance health technologies: A personas-based approach for a primary-care based multifactorial falls risk assessment tool.

INTRODUCTION: Multifactorial falls risk assessment tools (FRATs) can be an effective falls prevention method for older adults, but are often underutilized by health care professionals (HCPs). This study aims to enhance the use and implementation of multifactorial FRATs by combining behavioral theory with the user-centered design (UCD) method of personas construction. Specifically, the study aimed to (1) construct personas that are based on external (i.e., needs, preferences) and intrinsic user characteristics (i.e., behavioral determinants); and (2) use these insights to inform requirements for optimizing an existing Dutch multifactorial FRAT (i.e., the 'Valanalyse'). METHODS: Survey data from HCPs (n = 31) was used to construct personas of the 'Valanalyse.' To examine differences between clusters on 68 clustering variables, a multivariate cluster analysis technique with non-parametric analyses and computational methods was used. The aggregated external and intrinsic user characteristics of personas were used to inform key design and implementation requirements for the 'Valanalyse,' respectively, whereby intrinsic user characteristics were matched with appropriate behavior change techniques to guide implementation. RESULTS: Significant differences between clusters were observed in 20 clustering variables (e.g., behavioral beliefs, situations for use). These variables were used to construct six personas representing users of each cluster. Together, the six personas helped operationalize four key design requirements (e.g., guide treatment-related decision making) and 14 implementation strategies (e.g., planning coping responses) for optimizing the 'Valanalyse' in Dutch geriatric, primary care settings. CONCLUSION: The findings suggest that theory- and evidence-based personas that encompass both external and intrinsic user characteristics are a useful method for understanding how the use and implementation of multifactorial FRATs can be optimized with and for HCPs, providing important implications for developers and eHealth interventions with regards to encouraging technology adoption.

Development and Usability Testing of a Mobile App-Based Clinical Decision Support System for Delirium: Randomized Crossover Trial.

Background: The 3-Minute Diagnostic Interview for Confusion Assessment Method-Defined Delirium (3D-CAM) is an instrument specially developed for the assessment of delirium in general wards, with high reported sensitivity and specificity. However, the use of the 3D-CAM by bedside nurses in routine practice showed relatively poor usability, with multiple human errors during assessment. Objective: This study aimed to develop a mobile app-based delirium assessment tool based on the 3D-CAM and evaluate its usability among older patients by bedside nurses. Methods: The Delirium Assessment Tool With Decision Support Based on the 3D-CAM (3D-DST) was developed to address existing issues of the 3D-CAM and optimize the assessment process. Following a randomized crossover design, questionnaires were used to evaluate the usability of the 3D-DST among older adults by bedside nurses. Meanwhile, the performances of both the 3D-DST and the 3D-CAM paper version, including the assessment completion rate, time required for completing the assessment, and the number of human errors made by nurses during assessment, were recorded, and their differences were compared. Results: The 3D-DST included 3 assessment modules, 9 evaluation interfaces, and 16 results interfaces, with built-in reminders to guide nurses in completing the delirium assessment. In the usability testing, a total of 432 delirium assessments (216 pairs) on 148 older adults were performed by 72 bedside nurses with the 3D-CAM paper version and the 3D-DST. Compared to the 3D-CAM paper version, the mean usability score was significantly higher when using the 3D-DST (4.35 vs 3.40; P<.001). The median scores of the 6 domains of the satisfactory evaluation questionnaire for nurses using the 3D-CAM paper version and the 3D-DST were above 2.83 and 4.33 points, respectively (P<.001). The average time for completing the assessment reduced by 2.1 minutes (4.4 vs 2.3 min; P<.001) when the 3D-DST was used. Conclusions: This study demonstrated that the 3D-DST significantly improved the efficiency of delirium assessment and was considered highly acceptable by bedside nurses.

User-Centered Design to Develop Automated Short Message Service Messaging for Patient Support of Rheumatic Heart Disease Secondary Antibiotic Prophylaxis.

BACKGROUND: The Active Community Case Management Platform is a cloud-based technology developed to facilitate rheumatic heart disease case management by health care providers. This study aimed to design and pilot an automated short message service (SMS) intervention to support secondary prophylaxis adherence. METHODS AND RESULTS: We developed a concise library of messages to support secondary antibiotic prophylaxis. The SMS intervention used TextIT, an interface that enables users to send out interactive SMS messages at scale. The message bank was piloted in a cohort of 50 patients with rheumatic heart disease randomized into 2 groups. Group 1 received standard support (nurse-led/Active Community Case Management Platform). Group 2 received standard support plus SMS intervention for 2 months in the Lira and Gulu districts of Northern Uganda. We collected qualitative data on participants' experiences and assessed treatment adherence. Using a sequential user-centered process consisting of 4 phases (phases 1-4), we developed a message bank (n=43) deployed during our pilot study. There were no between-group differences in treatment adherence or acceptance. Interviews of participants indicated that the intervention was viewed positively. A total of 75% of SMS recipients responded to the messages, and 25% called the study staff to acknowledge receipt of text messages. CONCLUSIONS: This study has successfully developed a bank of SMS messages to support secondary antibiotic prophylaxis adherence. We have demonstrated the feasibility and acceptability of SMS technology in rheumatic heart disease care management. Future work will include integrating automated SMS into the Active Community Case Management Platform and a larger study of integrated SMS to reduce health care worker burden for patient support and improve adherence to secondary antibiotic prophylaxis.

Immersive experiences in museums for elderly with cognitive disorders: a user-centered design approach.

In the context of global aging, to explore the design needs of elderly with dementia in museum environments, to establish a user cognitive psychological model based on immersion theory, and to enhance the satisfaction of cognitively impaired dementia with the museum service experience. Using literature research, surveys, questionnaires, interviews, and focus groups, we analyze the experience design from the psychological demands of elderly with dementia, build a method of mining user needs by combining the KANO model with the analytic hierarchy process (AHP) method, and establish a model for evaluating the excellence of the experience of the museum environment. The conclusion shows that displaying museum virtual scenes or old objects can effectively increase the subjective well-being of people suffering from various health conditions. The method can accurately tap the attributes of the needs of elderly with dementia, break through the drawbacks of the traditional museum experience design which is dominated by the designer's subjective consciousness, and allow the audience to better experience the museum immersive experience, which provides a new idea and method for the effectiveness of cognitive interventions for elderly with cognitive disorders.

A Hybrid Physical-Digital Simulation Laboratory to Expedite Context-Aware Design and Usability Testing in Digital Health.

Fit within existing physical and digitalised workflows is a critical aspect of digital health software usability. Early, iterative exploration of contextual usability issues is complicated by barriers of access to healthcare settings. The Validitron SimLab is a new facility for digital health prototyping that augments immersive, realistic physical environments with a digital sandbox allowing new and existing software to be easily set up and tested in the physical space.

Accurate Dosing Weight: When the 10% Really Matters.

INTRODUCTION: Children are at increased risk of medication-associated adverse events, often due to weight-based dosing errors. We aimed to reduce the proportion of medications that were administered where the dosing weight was ≥ 10% different from the recorded weight. METHODS: We adopted in-situ usability testing to iteratively improve design of clinical decision support that would enable accurate dosing weight documentation by prompting clinicians to update weight if recorded weight was > 10% different and it had been at least 7 days since the last dosing weight update. RESULTS: The proportion of medication administrations with difference >10% between their recorded weight and dosing weight decreased from 13.1% (56,256/ 429,006) in the baseline period to 9.5% (35,560 / 372,443) in the intervention period (P < 0.001). DISCUSSION AND CONCLUSION: User-centered design of an interruptive alert improved the accuracy of dosing weights during medication administrations without substantial alert burden. In-situ usability testing is an effective approach to rapidly obtain feedback from frontline users and iterate on the design to effect desired behavior changes.

User-Centered Design and Usability of a Culturally Adapted Virtual Survivorship Care App for Chinese Canadian Prostate Cancer Survivors: Qualitative Descriptive Study.

BACKGROUND: Cultural adaptations of digital health innovations are a growing field. However, digital health innovations can increase health inequities. While completing exploratory work for the cultural adaptation of the Ned Clinic virtual survivorship app, we identified structural considerations that provided a space to design digitally connected and collective care. OBJECTIVE: This study used a community-based participatory research and user-centered design process to develop a cultural adaptation of the Ned Clinic app while designing to intervene in structural inequities. METHODS: The design process included primary data collection and qualitative analysis to explore and distill design principles, an iterative design phase with a multidisciplinary team, and a final evaluation phase with participants throughout the design process as a form of member checking and validation. RESULTS: Participants indicated that they found the final adapted prototype to be acceptable, appropriate, and feasible for their use. The changes made to adapt the prototype were not specifically culturally Chinese. Instead, we identified ways to strengthen connections between the survivor and their providers; improve accessibility to resources; and honor participants' desires for relationality, accountability, and care. CONCLUSIONS: We grounded the use of user-centered design to develop a prototype design that supports the acts of caring through digital technology by identifying and designing to resist structures that create health inequities in the lives of this community of survivors. By designing for collective justice, we can provide accessible, feasible, and relational care with digital health through the application of Indigenous and Black feminist ways of being and knowing.

User-Centered Design of a Diabetes Self-Management Tool for Underserved Populations.

BACKGROUND: User-centered design (UCD) or user experience design (UXD) methods have gained recent popularity for the design of mobile health (mHealth) interventions. However, there is a gap in application of these methods for diabetes self-management. This study aims to document the UCD process for a self-management mobile application aimed for patients with diabetes in underserved communities. METHODS: A UCD mixed-methods approach including interviews with patients and providers, a review of literature, and a technology landscape analysis were used to define the app functional information requirements that informed the user experience/user interface design process. Usability studies with the app designers and developers, intended users, and a focus group of nurse educators and dieticians were used to test and improve the design. RESULTS: An mHealth app was developed with health-tracking features for stress, blood sugar, food, exercise, medications, weight, and blood pressure. We tackled a range of usability and user experience challenges, which encompassed addressing issues like low health literacy by employing a combination of user interface design principles, intuitive visualizations, customizable icons, seamless database integration, and automated data input features. Special attention was given to the design of educational content accounting for the intended users' cultural background and literacy levels. CONCLUSIONS: User-centered design approach contributed to a better understanding of the intended users' needs, limitations, mental models, and expectations, facilitating the design of a comprehensive mobile app for patients with diabetes in underserved communities that includes essential features for self-management while providing a strong educational component, addressing an important gap in the literature.

Development of a Competency-Based Triage Education Application and Usability Testing for Triage Training Based on the Korean Triage and Acuity Scale.

BACKGROUND: Improving the quality of emergency nursing care requires enhancing triage competency through education programs that integrate the content of the Korean Triage and Acuity Scale, a triage system specifically developed for the Korean context. Thus, this study developed a competency-based triage education application (CTEA), based on the Korean Triage and Acuity Scale, and evaluated its effectiveness through usability testing. METHOD: The CTEA used various teaching methods and game mechanisms, including lectures, case studies, and video-based scenarios, to improve triage competency. RESULTS: In the usability testing phase, the CTEA was refined through expert heuristic evaluation and user interviews conducted with the think-aloud method. Six themes were derived from the interviews, highlighting the need for a well-structured program with realistic scenarios, easy accessibility, gamification, functional improvements, and future triage educational applications. CONCLUSION: These findings suggest that the CTEA is effective and satisfactory for users and can contribute to improving the triage competency of emergency nurses. [J Contin Educ Nurs. 2024;55(1):33-41.].

How to co-design a prototype of a clinical practice tool: a framework with practical guidance and a case study.

Clinical tools for use in practice-such as medicine reconciliation charts, diagnosis support tools and track-and-trigger charts-are endemic in healthcare, but relatively little attention is given to how to optimise their design. User-centred design approaches and co-design principles offer potential for improving usability and acceptability of clinical tools, but limited practical guidance is currently available. We propose a framework (FRamework for co-dESign of Clinical practice tOols or 'FRESCO') offering practical guidance based on user-centred methods and co-design principles, organised in five steps: (1) establish a multidisciplinary advisory group; (2) develop initial drafts of the prototype; (3) conduct think-aloud usability evaluations; (4) test in clinical simulations; (5) generate a final prototype informed by workshops. We applied the framework in a case study to support co-design of a prototype track-and-trigger chart for detecting and responding to possible fetal deterioration during labour. This started with establishing an advisory group of 22 members with varied expertise. Two initial draft prototypes were developed-one based on a version produced by national bodies, and the other with similar content but designed using human factors principles. Think-aloud usability evaluations of these prototypes were conducted with 15 professionals, and the findings used to inform co-design of an improved draft prototype. This was tested with 52 maternity professionals from five maternity units through clinical simulations. Analysis of these simulations and six workshops were used to co-design the final prototype to the point of readiness for large-scale testing. By codifying existing methods and principles into a single framework, FRESCO supported mobilisation of the expertise and ingenuity of diverse stakeholders to co-design a prototype track-and-trigger chart in an area of pressing service need. Subject to further evaluation, the framework has potential for application beyond the area of clinical practice in which it was applied.

User-Centered Development of STOP (Successful Treatment for Paranoia): Material Development and Usability Testing for a Digital Therapeutic for Paranoia.

BACKGROUND: Paranoia is a highly debilitating mental health condition. One novel intervention for paranoia is cognitive bias modification for paranoia (CBM-pa). CBM-pa comes from a class of interventions that focus on manipulating interpretation bias. Here, we aimed to develop and evaluate new therapy content for CBM-pa for later use in a self-administered digital therapeutic for paranoia called STOP ("Successful Treatment of Paranoia"). OBJECTIVE: This study aimed to (1) take a user-centered approach with input from living experts, clinicians, and academics to create and evaluate paranoia-relevant item content to be used in STOP and (2) engage with living experts and the design team from a digital health care solutions company to cocreate and pilot-test the STOP mobile app prototype. METHODS: We invited 18 people with living or lived experiences of paranoia to create text exemplars of personal, everyday emotionally ambiguous scenarios that could provoke paranoid thoughts. Researchers then adapted 240 suitable exemplars into corresponding intervention items in the format commonly used for CBM training and created 240 control items for the purpose of testing STOP. Each item included newly developed, visually enriching graphics content to increase the engagement and realism of the basic text scenarios. All items were then evaluated for their paranoia severity and readability by living experts (n=8) and clinicians (n=7) and for their item length by the research team. Items were evenly distributed into six 40-item sessions based on these evaluations. Finalized items were presented in the STOP mobile app, which was co-designed with a digital health care solutions company, living or lived experts, and the academic team; user acceptance was evaluated across 2 pilot tests involving living or lived experts. RESULTS: All materials reached predefined acceptable thresholds on all rating criteria: paranoia severity (intervention items: ≥1; control items: ≤1, readability: ≥3, and length of the scenarios), and there was no systematic difference between the intervention and control group materials overall or between individual sessions within each group. For item graphics, we also found no systematic differences in users' ratings of complexity (P=.68), attractiveness (P=.15), and interest (P=.14) between intervention and control group materials. User acceptance testing of the mobile app found that it is easy to use and navigate, interactive, and helpful. CONCLUSIONS: Material development for any new digital therapeutic requires an iterative and rigorous process of testing involving multiple contributing groups. Appropriate user-centered development can create user-friendly mobile health apps, which may improve face validity and have a greater chance of being engaging and acceptable to the target end users.

An Online Psychological Program for Adolescents and Young Adults With Headaches: Iterative Design and Rapid Usability Testing.

BACKGROUND: Headache disorders are common, debilitating health problems. Cognitive-behavioral therapy (CBT) is recommended but rarely easily available. With the use of the internet and communication technologies among youth and young adults, these individuals could be self-trained in CBT skills. There is an increasing number of internet-based interventions for headaches, but there has been little research into the usability of these interventions because evaluating usability across the intervention development life cycle is costly. We developed an internet-based CBT program, the Specialized Program for Headache Reduction (SPHERE). While developing it, we aimed to improve SPHERE through rapid usability testing cycles. OBJECTIVE: This study aims to presents a rapid and affordable usability testing approach that can be performed throughout the intervention development life cycle. This paper also provides evidence of the usability of SPHERE. METHODS: We used the "think aloud" usability testing method based on Krug's approach to test user interaction within a lab setting. This was followed by a short posttest interview. We planned to test SPHERE with 3-5 participants testing the same part of the program each cycle. Both the design and development team and the research team actively participated in the usability testing process. Observers independently identified the top 3 usability issues, rated their severity, and conducted debriefing sessions to come to consensus on major issues and generate potential solutions. RESULTS: The testing process allowed major usability issues to be identified and rectified rapidly before piloting SPHERE in a real-world context. A total of 2 cycles of testing were conducted. Of the usability issues encountered in cycles 1 and 2, a total of 68% (17/25) and 32% (12/38), respectively, were rated as major, discussed, and fixed. CONCLUSIONS: This study shows that rapid usability testing is an essential part of the design process that improves program functionality and can be easy and inexpensive to undertake.

Testing and Practical Implementation of a User-Friendly Personalized and Long-Term Electronic Informed Consent Prototype in Clinical Research: Mixed Methods Study.

BACKGROUND: Over the years, there has been increasing interest in electronic informed consent (eIC) in clinical research. The user-friendliness of an eIC application and its acceptance by stakeholders plays a central role in achieving successful implementation. OBJECTIVE: This study aims to identify insights for the design and implementation of a user-friendly, personalized, and long-term eIC application based on a usability study with (potential) research participants and semistructured interviews with stakeholders on the practical integration of such an application into their daily practice. METHODS: An eIC prototype was evaluated and refined through usability testing among Belgian citizens and iterative redesign. On the basis of a digital literacy questionnaire, a heterogeneous sample of participants was established. Participants needed to complete a series of usability tasks related to personalization and long-term interaction with the research team while using the "think aloud" technique. In addition, usability tests involved completing the System Usability Scale questionnaire and taking part in a semistructured feedback interview. Furthermore, semistructured interviews were conducted with ethics committee members, health care professionals, and pharmaceutical industry representatives active in Belgium and involved in clinical research. Thematic analysis was undertaken using the NVivo software (Lumivero). RESULTS: In total, 3 iterations of usability tests were conducted with 10 participants each. Each cycle involved some participants who reported having low digital skills. The System Usability Scale scores related to the tasks on personalization and long-term interaction increased after each iteration and reached 69.5 (SD 8.35) and 71.3 (SD 16.1) out of 100, respectively, which represents above-average usability. Semistructured interviews conducted with health care professionals (n=4), ethics committee members (n=8), and pharmaceutical industry representatives (n=5) identified the need for an eIC system that can be easily set up. For example, a library could be established enabling stakeholders to easily provide background information about a clinical study, presented in the second layer of the interface. In contrast, some functionalities, such as informing participants about new studies through an eIC system, were not considered useful by stakeholders. CONCLUSIONS: This study provides insights for the implementation of a user-friendly personalized and long-term eIC application. The study findings showed that usability testing is key to assessing and increasing the user-friendliness of an eIC application. Although this eIC system has the potential to be usable by a wide audience, participants with low digital literacy may not be able to use it successfully, highlighting the need for additional support for participants or other alternatives to an eIC system. In addition, key lessons emerging from the interviews included ensuring that the application is easy to implement in practice and is interoperable with other established systems.

User needs and design features of sanitation digital solutions in Kawempe division, Kampala Uganda: a user centered design approach.

Despite improvements in access to water and sanitation services globally, a significant population in Sub Saharan Africa has limited access to improved sanitation facilities. Furthermore, there is lack of a centralized digital platform for data exchange among stakeholders for sanitation services planning and provision in Uganda. A user centered design (UCD) approach was used to develop and pilot a one stop sanitation digital solutions (SaniDigS) center in Kawempe division, Kampala, Uganda. This involved three phases (1) understanding the sanitation status of the community which involved interviewing 1,844 household heads, (2) specifying the user needs of the proposed digital solution through stakeholder meetings and (3) Co designing of the innovations with potential users through stakeholder workshops. The quantitative data was visualized through the SaniDigS platform dashboard. The stakeholder meeting transcripts and notes were thematically analyzed to identify the user needs. The community user needs included an innovation that ensures confidentiality, is low cost and user friendly without internet connection. The service provider needed a sanitation digital solution that can market their sanitation products while, policy makers and planners needed comprehensive, real time data collection and sharing for trend analysis and informed decision making. The codesigned features of the SaniDigS informed by the user needs included: The SaniDigS Champion Application, SaniDigS platform dashboard, SaniDigS mobile application and the call center. The community in Kawempe showed need for subsidized sanitation products and we recommend further research to evaluate the effects of SaniDigS on planning, coordination, and access to sanitation services.

Towards Translation of Novel Neurorehabilitation Systems: A Practical Approach to Usability Testing.

Usability testing is important for the effective translation of neurorehabilitation technologies but is often overlooked and under-reported. The aim of this paper is to present a method of collecting and analyzing usability data, using a think-aloud and semi-structured interview protocol and qualitative analysis techniques. We present a worked case study of this method with a novel neurorehabilitation system that utilizes thought-controlled robotics to partially restore lower-limb function of people with spinal cord injury (SCI). Five male participants (mean age = 32.6 years) with SCI who identified as users of related neurorehabilitation technologies completed the usability study. Video-recorded usability sessions utilized a combination of concurrent and retrospective think-aloud methods as well as semi-structured interviews. Recordings were analyzed to identify verbal and behavioral feedback from participants regarding system performance and acceptability. In total, 538 data points were logged, which were aggregated into 60 usability issues, 44 positive evaluations, and 31 strategies for improvement. The approach undertaken was novel in that we sought to not only capture usability issues but also system elements that were positively evaluated by intended users and strategies for improvement from the perspective of intended users. These observations will be used to inform the further development of the neurorehabilitation system.

Incorporating Community Partner Perspectives on eHealth Technology Data Sharing Practices for the California Early Psychosis Intervention Network: Qualitative Focus Group Study With a User-Centered Design Approach.

BACKGROUND: Increased use of eHealth technology and user data to drive early identification and intervention algorithms in early psychosis (EP) necessitates the implementation of ethical data use practices to increase user acceptability and trust. OBJECTIVE: First, the study explored EP community partner perspectives on data sharing best practices, including beliefs, attitudes, and preferences for ethical data sharing and how best to present end-user license agreements (EULAs). Second, we present a test case of adopting a user-centered design approach to develop a EULA protocol consistent with community partner perspectives and priorities. METHODS: We conducted an exploratory, qualitative, and focus group-based study exploring mental health data sharing and privacy preferences among individuals involved in delivering or receiving EP care within the California Early Psychosis Intervention Network. Key themes were identified through a content analysis of focus group transcripts. Additionally, we conducted workshops using a user-centered design approach to develop a EULA that addresses participant priorities. RESULTS: In total, 24 participants took part in the study (14 EP providers, 6 clients, and 4 family members). Participants reported being receptive to data sharing despite being acutely aware of widespread third-party sharing across digital domains, the risk of breaches, and motives hidden in the legal language of EULAs. Consequently, they reported feeling a loss of control and a lack of protection over their data. Participants indicated these concerns could be mitigated through user-level control for data sharing with third parties and an understandable, transparent EULA, including multiple presentation modalities, text at no more than an eighth-grade reading level, and a clear definition of key terms. These findings were successfully integrated into the development of a EULA and data opt-in process that resulted in 88.1% (421/478) of clients who reviewed the video agreeing to share data. CONCLUSIONS: Many of the factors considered pertinent to informing data sharing practices in a mental health setting are consistent among clients, family members, and providers delivering or receiving EP care. These community partners' priorities can be successfully incorporated into developing EULA practices that can lead to high voluntary data sharing rates.

Developing an Audit and Feedback Dashboard for Family Physicians: User-Centered Design Process.

BACKGROUND: Audit and feedback (A&F), the summary and provision of clinical performance data, is a common quality improvement strategy. Successful design and implementation of A&F-or any quality improvement strategy-should incorporate evidence-informed best practices as well as context-specific end user input. OBJECTIVE: We used A&F theory and user-centered design to inform the development of a web-based primary care A&F dashboard. We describe the design process and how it influenced the design of the dashboard. METHODS: Our design process included 3 phases: prototype development based on A&F theory and input from clinical improvement leaders; workshop with family physician quality improvement leaders to develop personas (ie, fictional users that represent an archetype character representative of our key users) and application of those personas to design decisions; and user-centered interviews with family physicians to learn about the physician's reactions to the revised dashboard. RESULTS: The team applied A&F best practices to the dashboard prototype. Personas were used to identify target groups with challenges and behaviors as a tool for informed design decision-making. Our workshop produced 3 user personas, Dr Skeptic, Frazzled Physician, and Eager Implementer, representing common users based on the team's experience of A&F. Interviews were conducted to further validate findings from the persona workshop and found that (1) physicians were interested in how they compare with peers; however, if performance was above average, they were not motivated to improve even if gaps compared to other standards in their care remained; (2) burnout levels were high as physicians are trying to catch up on missed care during the pandemic and are therefore less motivated to act on the data; and (3) additional desired features included integration within the electronic medical record, and more up-to-date and accurate data. CONCLUSIONS: We found that carefully incorporating data from user interviews helped operationalize generic best practices for A&F to achieve an acceptable dashboard that could meet the needs and goals of physicians. We demonstrate such a design process in this paper. A&F dashboards should address physicians' data skepticism, present data in a way that spurs action, and support physicians to have the time and capacity to engage in quality improvement work; the steps we followed may help those responsible for quality improvement strategy implementation achieve these aims.

Digital Health Equity and Tailored Health Care Service for People With Disability: User-Centered Design and Usability Study.

BACKGROUND: As digital health services advance, digital health equity has become a significant concern. However, people with disability and older adults still face health management limitations, particularly in the COVID-19 pandemic. An essential area of investigation is proposing a patient-centered design strategy that uses patient-generated health data (PGHD) to facilitate optimal communication with caregivers and health care service providers. OBJECTIVE: This study aims to conceptualize, develop, and validate a digitally integrated health care service platform for people with disability, caregivers, and health care professionals, using Internet of Things devices and PGHD to contribute to improving digital health equity. METHODS: The methodology consists of 5 stages. First, a collaborative review of the previous app, Daily Healthcare 1.0, was conducted with individuals with disabilities, caregivers, and health care professionals. Secondly, user needs were identified via personas, scenarios, and user interface sketches to shape a user-centered service design. The third stage created an enhanced app that integrated these specifications. In the fourth stage, heuristic evaluations by clinical and app experts paved the way for Daily Healthcare 2.0, now featuring Internet of Things device integration. Conclusively, in the fifth stage, an extensive 2-month usability evaluation was executed with user groups comprising individuals with disabilities using the app and their caregivers. RESULTS: Among the participants, "disability welfare information and related institutional linkage" was the highest priority. Three of the 14 user interface sketches the participants created were related to "providing educational content." The 11 heuristic evaluation experts identified "focusing on a single task" as a crucial issue and advocated redesigning the home menu to simplify it and integrate detailed menus. Subsequently, the app Daily Healthcare 2.0 was developed, incorporating wearable devices for collecting PGHD and connecting individuals with disabilities, caregivers, and health care professionals. After the 2-month usability evaluation with 27 participants, all participants showed an increase in eHealth literacy, particularly those who used the caregiver app. Relatively older users demonstrated improved scores in health IT usability and smartphone self-efficacy. All users' satisfaction and willingness to recommend increased, although their willingness to pay decreased. CONCLUSIONS: In this study, we underscore the significance of incorporating the distinct needs of individuals with disabilities, caregivers, and health care professionals from the design phase of a digital health care service, highlighting its potential to advance digital health equity. Our findings also elucidate the potential benefits of fostering partnerships between health consumers and providers, thereby attenuating the vulnerability of marginalized groups, even amid crises such as the COVID-19 pandemic. Emphasizing this imperative, we advocate for sustained endeavors to bolster the digital literacy of individuals with disabilities and champion collaborative cocreation, aiming to uphold the collective ethos of health and digital health equity.